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1. Related Applications 
This application incorporates by reference, and claims priority from, the United States 
provisional patent application entitled^ "Streaming Audio and Video for Multiple Users," 
serial number 60/034,128, having inventors Michael J. Fuller and John J. Graham. 

2. The Background of the Invention 

a. The Field of the Invention 

This invention relates to the field of network delivery of audio and video information. In 
particular, the invention relates to a system for delivering audio and video information to 
multiple users. 

b. Background Information 

The Internet enables many different ways of communicating. Originally, the Intemet was 
used for the exchange of files and electronic mail. As the capabilities of the Intemet expand, 
other types of commimications are enabled. 

Audio and video transmissions are an important area of the communications that the 
Intemet enables. For example, many technologies support the transmission of digital video 
and/or audio signals over the Intemet. An example of such a technology is Quicktime™, 
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available Gcom Apple Computer, Inc., of Cupertino California. Quicklime movies are files 
that can be transmitted across the Internet Quicktime provides both audio and video 
displays. Many other file formats allow audio and video to be displayed on people's 
computers. 

This paragraph describes an example use of a the Quicktime technology. A user will have 
a browser application that resides on his/her computer. The computer, acting as a client under 
the direction of the browser application, will connect to various World Wide Web (web) 
servers. Each web server will typically serve hypertext markup language (HTML) files to the 
clients. The files may include text, graphics references, and references to specialized files. 
Some of these specialized files can include audio and video information in Quicktime form. 
The clients can then play these audio and video files once they are downloaded using a 
Quicktime plug-in, a helper application, or Quicktime capabilities built into the browser 
implication. A plug-in and a helper application are described in greater detail below. 

Streaming audio and video, as a subset of all the types of audio and video that can be 
transmitted over the Internet, allow people to broadcast long and/or live video and audio 
transmissions across the Internet Streaming video and audio is video and audio digital data 
that is transmitted on a continuous basis. A client can access the data stream and regenerate 
the video images and audio signal as they are being transmitted. Streaming technology is 
particularly helpfiil where the events are live, or where the files would be so large as to be a 
burden on the end users. Examples of where streaming technology is particularly useful are 
for the display of conferences, sporting events, radio broadcasts, television broadcasts, and 
the like. 
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RealNetworks, Inc. of Seattle, Washington, provides a system for transmitting streaming 
audio and video signals to users over the Intemet RealNetworks supplies a server that allows 
multiple users to simultaneously receive streaming audio and video. 

The real audio system requires that not only the client have additional software, but that 
5 the content provider have a separate server from their normal web server. For a client to 
receive a real audio broadcast, the client typically connects through their browser to a Web 
page with a reference to a real audio server. The client then accesses its separate real audio 
player program. The real audio player program then connects to the referenced real audio 
server. A significant drawback to such an arrangement is that the user must download the 

10 real audio player program. This program must then be installed on the user's computer. This 
may cause a number of problems for the user. For example, if the user is behind a firewall, or 
some security program, the client may not be able to receive the broadcast firom the server. 
Additionally, the installation of any program may have conflicts with other programs. The 
program has the disadvantage of being platform specific. This means that a different program 

1 S must be developed and downloaded for each type of computer that is to be used to access 
RealNetworks broadcasts. Additionally, the broadcasters of the streaming audio and video 
need to use the RealNetworks server, which is separate fit>m the broadcasters* World Wide 
Web server (also referred to as the web server). This increases the broadcasters' security 
problems because now the broadcasters must be concerned with two separate servers. 

20 Another example of a video and audio system that uses Intemet like communications is 

the MBone. The MBone is a specialized conmumication network that allows for the 
distribution of streaming video and audio signals to multiple users, A specialized network is 
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set up specifically to transmit MBone communications. A significant drawback of this 
system is that users must be connected to the specialized network. Additionally, users will be 
required to have specialized software on their computers to listen to and watch MBone 
transmissions. 

A streaming videb system, not requiring a user to download a separate program, was 
developed for a single user by John Graham of California. This single user broadcast 
technology allowed a web server to serve a single streaming video signal to a single client. 
Although the user did not need to download a plug-in to see the video, only one user was 
allowed to access the video stream at a time. In this system, video information was captured 
fi'om a video camera and digitized. The digital video information was then encapsulated in a 
MIME encoded multipart data stream. The client received this data stream and reconstmcted 
frames of the digital video. 

Therefore, what is desired is a platform independent video and audio streaming system 
that does not require the user to download additional programs beyond the functionalities 
found in a browser. 
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3. A Summary of the Invention 

A system and method of providing streaming audio and video data to multiple users is 
described. In one embodiment, the system comprises a first client, a second client and a 
server. The first and second clients ace executing browsers. The server can communicate 
with the two clients. The server concurrently provides streaming audio and video data to both 
of the clients. Importantly, the server does not require the two browsers to use a plug-in or a 
helper application to receive and use the streaming audio and video data. 

In some embodiments of the invention, a browser causes a client to request an HTML file 
from a web server. The client receives the HTML file. The HTML file includes an HTML 
tag that directs the browser to load one or more applets from the server. The browse 
executes the applets causing the browser to request streaming audio and video from the web 
server. That request may or may not include parameters giving information about the type of 
request being made. The web server associates a server process with the request, given the 
parameters in the request. The web server notifies real-time audio and video process that 
streaming audio and video information is needed. In response to the notification, the real- 
time audio and video process stores encoded audio and video data in a shared memory 
locatioiL The server process accesses the shared memory and inserts the audio and video data 
into one or more data streams. The client receives the data streams and reconstructs the audio 
and video signals using only the capabilities of the browser. In some embodiments, a 
separate stream and server process is used for each of the audio and video data. These 
embodiments allow multiple clients to simultaneously receive the same audio and video data. 

Other embodiments of the invention include a web server that can serve streaming audio 
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and video information as well as perform more usual web server functions (such as, serving 
web pages, performing file transfers, supporting secure communications). These 
embodiments have the advantage of allowing the broadcasters and the users to set up their 
security configurations for one web server, rather than two servers (a web server and a 
streaming audio and video server). 

Although many details have been included in the description and the figures, the 
invention is defined by the scope of the claims. Only limitations foimd in those claims apply 
to the invention. 
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4. A Brief Description of the Drawings 



The figures illustrate the invention by way of example, and not limitation. Like references 
indicate similar elements. 

Figure 1 illustrates a system including one embodiment of a streaming audio and video 
S system for multiple users where client computers do not need plug-ins or helper programs. 

Figure 2 illustrates an example method of streaming audio and video for multiple users. 
Figure 3 illustrates a web page that a user can use to access a streaming audio and video 
broadcast. 

Figure 4 illustrates a web page for selecting the bandwidth of the user's Internet 
10 coniiection. 



The following sections describe embodiments of the invention. The first section provides 
definitions that will help in the understanding of the remaining sections. The second section 
IS shows an example system that supports various embodiments of the invention. The third 

section describes an example method of using the invention. The fourth section illustrates an 
actual use of the streaming audio and video used in some embodiments of the invention. The 
last section reviews additional alternative embodiments of the invention. 



Figure 5 illustrates a web page having streaming audio and video. 
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a. Definitions 



The following definitions will help in the understanding of the following description. 
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Client: a computer, process, program, or combination of computers, processes or 
programs, that can communicate with a server. 

Server: a computer, process, program, or combination of computers, processes or 
programs, that can communicate with a client. The server and the client can be 
executing on the same computer(s). 

Web server: a server for serving at least Internet related requests. Example web servers 
can serve HTML pages in response to HTTP requests from clients. Some web servers 
can serve many different kinds of requests, e.g., HTTPS, and/or FTP. 

Browser: an application, program, process, or combination of applications, programs or 
processes, that allow a client to make a request of a web server and process the results 
of the request. The browser may be part of a stand alone application or a set of 
programs that are integrated into the operating system of the client. 

Plug-in: plug-ins are external software programs that extend the capabilities of the 

browser in a specific way. For example, a plug-in can be used to give the browser the 
ability to play audio samples or view video movies fix>m within the browser. 

Helper application: like plug-ins, helper applications are external software programs. The 
browser redirects some types of file to the helper applications. The helper 
applications allow clients to process many different types of files on the Internet. 
When the browser encounters a sound, image, or video file, the browser hands off the 
data to the helper ^plications to run or display the file. 

JavaScript: a stand-alone progranuning language built into many browsers. Primarily an 
extension to the Internet standard HTML language. 
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Java: a programming language whose programs (called applets) can travel over the 

Intemet for use by clients. Whereas plug-ins and helper appUcations are tailored for a 
particular type of client, Java applets generally work across the Intemet regardless of 
the type of client. Many browsers include Java capabilities so Java applets require no 
installation. Except where noted, Java and JavaScript are interchangeable. 

System 

Figure 1 illustrates a system including one embodiment of the invention where audio and 
video is supplied over the Intemet to multiple users. The following paragraphs first list the 
elements of Figure 1, describe their interconnections, and then describe the various elements 
in greater detail. 

This paragraph lists the elements of Figure 1. Figure 1 includes a system having three 
parts: a client side 100, a communications interface 180, and a server iside 130. The client 
side 100 includes a client 1 12 and a client 111. The client 1 12 includes a browser 102 having 
a video display area 103. The cheat 111 includes a browser 108 and a video display area 104. 
The communications interface 180 includes the Intemet 18S. The server side 130 includes a 
web server 131, a shared memory 135, and a real-time server 140. The web server 131 
includes two processes, a process 138 and a process 139. The real-time server 140 includes a 
video module 144, an audio module 146, a video proxy 148, and an audio proxy 149. The 
real-time server 140 interfaces with a number of other elements. These elements include a 
video card 159, an input audio interface 162, and an HTTP connection to remote server 170. 
Various elements of Figure 1 have now been listed. 
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The following paragnqihs describe the interconnections between the elements of Figure 1. 
Beginning on the server side 130, the video card 159 receives a video input 158 outputs a 
digital video signal to the video module 144. Similarly, an input audio interface 162 receives 
a mike input 164 and/or a line input 166 and outputs a digital audio signal to the audio 
module 146. The HTTP connection to remote server 170 receives a streaming audio and 
video data 175. The HTTP connection to remote server 170 outputs the video data to the 
video proxy module 148 and the audio data to the audio proxy module 149. The real-time 
server 140 uses the data received by the various modules and stores portions of that data in 
the shared memory 135, after some manipulation of the data. The shared memory 135 is 
accessed by the web server 131. The process 138 and the process 139 transmit and receive 
data to the communications interface 180. Thus, the couplings of the server side 130 have 
been described. In some embodiments, the process 138 and the process 139 correspond to 
HTTPD processes. 

The commimications interface 180 allows the client side 100 to communicate with the 
server side 130. The communications interface, and the Internet 185 in particular, support 
many difiTerent types of connections by the client side 100 and the server side 130. In the 
example communications interface 180, the communications interface 180 includes the 
Internet 185. In particular, in this example, the process 138 is communicating streaming 
audio and video data 176 to the Internet 185. Similarly, the process 139 is communicating 
the streaming audio and video data 178 to the Internet 185. 

On the client side 100, the client 1 12 is communicating the streaming audio and video 
data 176 with the Internet 185. Similarly, the client 1 1 1 is communicating with the Internet 
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185 to receive and manage the streaming audio and video data 178. The clients then 
communicate the information to their respective browser applications. The browser 
applications the generate video images in their respective video display areas. 

Thus, the connections between the various elements of Figure 1 have been described. 
Now the various elenlents will be described in greater detail in the following paragraphs. An 
example method of using these elements is described below in relation to Figure 2. 

The server side 130 will be described first. 

The video input 1S8 represents a video signal that a user of such a system wishes to 
broadcast to the clients on the client side 100. The video input 1S8 can include analog signals 
representing video information. The video card 159 digitizes the video input 158 to produce 
a digital video image. Various embodiments of the invention include Sun video cards 
available from Sun Microsystems, of Mountain View, California, and Parallax XVideo 
Xtra™ video cards, available from Parallax Graphics, Inc., of Santa Clara, California. 
However, what is important is that the real-time server 140, and in particular the video 
module 144, receives some sort of digitized video signal. The video module 144 is 
responsible for providing the real-time server 140 with the video information that will be 
broadcast to the client side 100. The video module 144 can convert the digitized video 
signals to be of better use to the rest of the system. For example, the video module 144 may, 
if not done by the video card 159, convert digital video data into a sequence of JPEG digital 
video frames. In any case, what is important is that the real-time server 140 receives digital 
video information in a format that it can use (example formats include, JPEG, MPEG, GIF, 
and AVI). 
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Similarly, the input audio interface 162 allows for the input of analog audio signals and 
converts this input to digital audio signals. What is important is that the audio module 146 
receives a digitized audio signal that can be used by the real-time server 140. The audio 
module 146 may convert the digitized audio signal into any of a niunber of foraiats, 
5 corresponding to any of a number of audio transmission rates (examples include G.71 1 and 
G.723 audio compression fomiats). 

The HTTP connection to remote server 170 represents an important advantage of one 
embodiment of the invention. In this embodiment, the HTTP connection to remote server 
170 allows the server side 130 to forward broadcasts of audio and video signals from other 

10 streaming audio and video servers. In these uses, the server side 130 acts as a client to 
another server. The HTTP connection to remote server 170 can receive video and audio 
signals being broadcast through the Internet 185 from another server. The HTTP connection 
to remote server 170 provides the digital video information from the other server to the video 
proxy module 148. Similarly, the HTTP connection to remote server 170 provides the audio 

IS data to the audio proxy module 149. The video proxy module 148 and the audio proxy 
module 149 then supply the respective video and audio data to the real-time server 140. 

The real-time server 140 represents an ^plication, or set of implications, executing on 
one or more computers, that prepares audio and video data for broadcasting to multiple users 
through the web server 131. The real-time server 140 takes the data from the various 

20 modules, processes the data, and stores the processed data in the shared memory 135. The 

real-time server 140 can perform compression, and other manipulations of the data, to reduce 
the processing burden on the web server 131. For example, in some embodiments of the 
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invention, the real-time server 140 receives digitized video data and compresses that data into 
JPEG images. These JPEG images are sequenced digital frames of video. Similarly, for the 
audio data, the real-time server 140 breaks the audio information into one-half second time 
periods of audio data (other embodiments use other time periods). These one-half second 
time periods of data are stored in the shared memory 135. The real-time server 140 can also 
compress the audio information into one of a number of various compressed audio signals 
(e.g., G.71 1 and/or G.723 audio compression formats). In some embodiments of the 
invention, the real-time server can broadcast audio and video from multiple sources to 
multiple clients. 

The shared memory 13S represents a shared storage area for use by the real-time server to 
store audio and video data for access by the web server 131. In one embodiment the shared 
memory 135 has a locking and semaphore usage scheme to ensure that the real-time server 
140 is not writing data into the shared memory 135 while the web server 131 is accessing that 
data. In some embodiments, the semaphores act as notifiers to indicate that new data in the 
shared memory 135 is available for use by the web server 131. In some embodiments, the 
video data and the audio data are stored in different shared memory locations. 

The web server 131 communicates data over the Internet 185 using one or more 
communications protocols. In some embodiments of the invention, these protocols include 
HTTP (Hypertext Transfer Protocol), TCP (Transmission Control Protocol) and UDP (User 
Datagram Protocol). The web server 131 represents an application, including one or more 
processes, for communicating over the Internet 185. In one embodiment, the web server 131 
includes an Apache web server. Each of the processes in the web server 131 represents one or 
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more processes for serving streaming audio and video data to the client side 100. In some 
embodiments, the web server 131 transmits the video data as a multipart MIME (multi- 
purpose Internet mail extensions) encoded file for decoding directly by the browser or as 
compressed video information for decoding by an applet run in the browser. The web server 
S 131 transmits the audio data as compressed audio data for decoding by an applet run in the 
browser. 

In some embodiments, the web server 131 initiates a separate process for each audio and 
video connection made from client side 100. Thus, for one client receiving streaming audio 
and video data, two processes would be started within the web server 131. The first process 
10 would supply video data and the second process would supply audio data. The processes 

access the shared memory 135 and serve the data across tbe Internet to the respective client. 

In some embodiments, the web server 131 initiates at least one process for each client. 
This provides important advantages in some embodiments of the invention. In particular, 
because the web server 13 1 is serving the data directly through processes it created, server 
IS side 130 users need not worry about security issues beyond those already faced with their web 
server 131. Thus, these embodiments of the invention have a lower chance of interfering with 
client side 100 fire walls and have a lower chance of having a server side 130 security 
problem. 

Other embodiments of the invention include separate Conunon Gateway Interface (CGI) 
20 programs for audio and video. These CGI programs are used by the web server 131 to serve 
the streaming audio and video data. These CGI programs are not necessarily integrated as 
tightly to the web server 131 as the process 138 and the process 139. However, a CGI 
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program allows for the easy extension of many different types of web servers. 

The communications interface 180 permits communications between the server side 130 
and the client side 100. In this example, the Internet 18S supports the conununications. 
Other embodiments of the invention support other communications interfaces. For example, 
the Internet 185 can be replaced by a local area network, a wide are network, a proprietary 
telecommunications and networking infirastmcture, or some other communications interface. 
What is important is that the server side 130 can communicate with the client side 100. The 
communications interface 1 80 can also include combinations of the above described 
technologies. For example, the Internet 185 can include a web server to which the clients on 
the client side communicate through to access the Internet 185. The client side 100 can be on 
a local area network that is connected through a server, or router, to the Internet 1 85. 

The client side 100 represents the consumers of the streaming audio and video data. In 
this example, the two clients are receiving separated streaming audio and video data signals. 
Other embodiments of the invention support many more clients. 

The client 112 represents a computer, such as a PC compatible computer, running a 
browser application 102. For video display, the browser s^plication 102 can include a 
Netscape Navigator™ or Communicator™ program for '"multipart/x-mixed-replace MIME 
type video,'* or a Microsoft Internet Explorer™ 3.0 or later for a Java based video 
transmission. In some embodiments, the Java based video transmission applet parses the 
multipart/x-mixed-replace MIME type video. For audio, the browser application 102 can 
include any browser that supports Java and/or JavaScript 

The browser application 102 is responsible for receiving the streaming audio and video 
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data 176 and reconstructing an audio and video signal suitable for the end user. In this 
example, the video display area 103 displays the reconstructed video information received 
from the video input 158 at the real-time server 140. Similarly, the client 1 1 1 is executing the 
browser 108. The browser 108 is displaying the same video signal in the video display area 
104. The client 1 1 1 represents another computer executing a browser application. 

Various embodiments of the invention have modifications to the system shown in 
Figure 1. Some of these variations are described in this paragraph. For example, the client 
111 and the client 112 can be the same computer or be different computers. The clients can 
be on the same local area network or be on completely different local area networks. There 
can be many more clients receiving the information from the client side 100. Additionally, as 
shown with the HTTP connection to remote server 170, a real-time server 140 can appear on 
the client side 100 to distribute data to other clients. 

Note that portions of the system, and embodiments of the invention, are sets of computer 
programs or computer that can be stored on computer usable media such as floppy disks, hard 
drives, CD ROMs, Zip disks, etc. 

Thus, an example system supporting streaming audio and video data for multiple users 
has been described. 

ff, E?^amplg Mgth94 

Figure 2 illustrates one example of a method of broadcasting streaming audio and video 
data to multiple users. This example method could be executed on the system of Figure 1. In 
this example, the client 112 will initiate a request to receive streaming audio and video data 
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176 from the server side 130. The client 112 will display the video data in the video display 
area 103 and will play the audio data for the user. Importantly, the client 112 can play audio 
and video without the need of a plug-in of helper application. As will be shown, the audio 
and video play as part of a transparent process of the client 112 loading a web page from the 
server 131, 

At block 210, the client 1 12 initiates an HTTP request from the web server 131. This 
could be the result of the browser 102 receiving and displaying an HTML (hypertext marlcup 
language) page including a link that will initiate streaming audio and video. The user would 
have selected this link which will then result in the browser 102 making the connection to the 
web server 131. 

As a result of the connection, at block 220, the web server 131 supplies a Java applet for 
decoding audio data and that will help in the display of video information. These instructions 
could be supplied as two separate Java s^plets or one combined Java applet. 

At block 230, the client executes the Java applets. The video display portion of the applet 
initiates a request of the web server 131 for a HTTP transmission of a multipart/mixed 
replace MIME encoded video (or in other embodiments, video data for Java decoding). Also 
at block 230, the audio Java applet makes a similar request of the web server 131. The 
requests can include optional information such as desired video frame rates or audio rates. 
The requests include the URI (universal resource indicator) indicating the particular audio or 
video streaming information to be served. 

The following will describe the audio serving by the web server 131 and eventual 
decoding by the client 112. The video serving will be described after the audio. 
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At block 240, in response to executing the Java applet, the client makes an audio request 
of the web server 131. This is done through the Java applet which supplies a miiversal 
resource indicator to the web server 131. The universal resource indicator can indicate the 
audio stream that is being requested. This request looks, to the client 112, like a file 
5 download request. The web server 131 responds accordingly to this request by beginning to 
transfer the streaming audio information. Importantly, the client 1 12 does not need to know 
that the file is a streaming audio or video signal that is essentially never ending. 

In response to the client request, the web server 131, and in particular the process 138, 
makes an audio data request of the shared memory 135. Note, if the process 138 had not been 
10 created, the web server 131 creates the process (in some embodiments, the web server 131 
creates a separate process for each of the audio and video data streams). The audio data 
request of the shared memory is done by the web server 131, and in particular by the process 
138, by notifying the real-time server 140 that audio information is requested. In subsequent 
iterations, the web server 131 need not make the explicit request for the audio information. 
IS Once requested, the real-time server 140 will continue to provide audio information, in these 
embodiments, until it is told to stop. 

In any case, the real-time server 140, in response to the request, prepares audio 
information and writes this information into the shared memory 135. In various 
embodiments of the invention, the real-time server 140 prepares the audio data by breaking 
20 the audio information into time periods. This audio information is also compressed into 
various sets of compressed data corresponding to different audio rates. Higher audio rates 
correspond to better quality audio signals. In these embodiments of the invention, the real- 
Video and Audio Streaming for PATENT Inventor(s): Michael J. Fuller. John 
Multiple Users Page 18 J. Graham 

::ODMA\PCDOCS\SQLl\l95543\l 
Attorney Docket Number 1 7503.703 



time server 140 writes the data for the various audio rates to the shared memory 135, thereby 
reducing the work load of the web server 131. Different web server 131 processes will 
require different audio rates depending on their connections to their respective clients. By 
storing the infomiation corresponding to the different audio rates into the shared memory 
S 135, each process can access the desired audio rate data torn the shared memory 135. Thus, 
the web server 131 need not calculate the compressed audio data for each process within the 
web server 131. 

The process 138, through the web server 131, now transmits the data accessed from the 
shared memory 135. This corresponds to block 246. 
10 At block 248, the client 112 receives the compressed audio data. The client decompresses 

the audio data as commanded by Java audio applet, and plays the audio information through 
the audio system of the client 1 12. 

At block 241, a test is made to detenhine whether the web server 131 should continue 
broadcasting the streaming audio information to the client 1 12. This test is made by 
15 determining whether the client 1 12 has broken the connection to the web server 131. 

The web server will continue serving the data as long as the client 1 12 is cormected to the 
web server 131 through the Java audio applet. 

Note, importantly, the user at the client 112 has not had to download any additional plug- 
ins or helper prograihs to play the streaming audio information. 
20 Turning to the video broadcasting, at block 252, the web server 131 makes a video 

information request to the real-time server 140. The real-time server 140 takes each video 
frame from the video module 144, or the video proxy module 148, and compresses that 
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information into a JPEG image. In some embodiments of the invention, the video card 159 
provides the images as JPEGs. The requesting procedure is similar to that followed in the 
audio request block 240. 

The real-time server 140, at block 254, writes one JPEG frame into the shared memory 
5 135. The process 138 accesses the shared memory 135 to retrieve the JPEG frame and 

transmit that frame to the client 1 12. At block 256, the process also formats the JPEG as part 
of a multipart MIME encoded file. 

At block 258, the client 1 12, using the capabilities of the browser 102, decompresses the 
video data from the MIME encoded format, and the JPEG encoded form, and creates the 
10 video display 103. 

At block 25 1, the web server 131 determines whether the video Java applet is still 
requesting video frames. Block 254 through block 251 are then repeated. The result of these 
blocks is that multiple frames of video information is displayed in the video display 103. 
Thus, the user has the perception of a video display at the client 112. 
15 Note, by the time the audio information is played from the previous audio transmission, a 

new audio transmission has been received and decompressed. Thus, the client 112 will have 
a continuous audio signal being presented to the user. 

If it is the case that the audio, or the video, information is not being received by the client 
1 12 at a sufiScient data rate, the corresponding Java applet, in some embodiments of the 
20 invention, can request a different rate of transmission. The Java applet can request a lower 
rate corresponding to a lower audio or video signal, that will more appropriately match the 
bandwidth availability of the client 112. 
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One advantage of the system of Figure 1 is that if the web server 131 becomes heavily 
loaded, the video frame rate is automatically reduced. This is done by ensuring that the audio 
processes take priority over the video processes. If a video process cannot access the shared 
memory 135 in sufficient time, that video frame will simply not be transmitted to the client 
112. However, the corresponding audio process should have an opportunity to transmit the 
audio information. 

As has been seen by the above discussion, the user has not been required to download any 
plug-ins or use any helper applications in the receiving of the streaming audio and video data. 
Additionally, the web server 131 is able to execute this example method for multiple clients. 
Each client would have a corresponding set of processes in the web server 131. The number 
of processes is only limited to the number of connections that can be supported by the web 
server 131. As has been noted, some of the work that would normally be performed by the 
web server 131 has been moved into the real-time server 140 to reduce the load on the web 
server 131. 

d. Example Video Display 

Figure 3 through Figure S represent the interface presented to a user using a browser 102 
on a client 112. In this example, the user is using a standard PC with a standard Netscape 
Communicator™ 4.0 browser application. Figure 3 includes a browser window 302 with a 
cursor positioned over a transmission selection link 304. The transmission selection link 304 
corresponds to a request for transmission of streaming audio and video data. Figure 4 
illustrates the result of the selection of the transmission selection link 304. The user is 
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presented with a number of connection speeds to select from. The user selects the speed 



associated with his or her connection speed to the Internet 185. In this example, the user is 



selecting a Tl or better connection speed. In one embodiment of the invention, the Java 



applets are controlling the presentation of the various selection speeds. This is shown as a 



5 



bandwidth selection link 404. 



Figure 5 illustrates the result of the *T1 or higher^* bandwidth selection link being chosen. 
A digital video display 502 is shown in the browser window 302. The client computer 
executing, the Netscape Communicator browser, is playing an audio signal corresponding to 
the digital video display 502. In this example, a user is allowed to modify the video rate, 

10 shown in frames per second, by selecting one of the video rate selectors 510. A result of 
selecting one of the various video rate selectors 510 would be that the corresponding video 
Java applet will communicate with its corresponding process in the web server 131. The Java 
applet would request a change in the video frame per second rate being supplied by the 
process in the web server 131. Similarly, a set of audio rate selectors 512 allow the user to 

15 select a higher or lower quality audio signal. The corresponding Java audio applet would 
commimicate with its corresponding process in the web server 131 to request the change in 
the audio rate. 

e. Additional Embodiments 

Thus a system for broadcasting streaming video and audio information to multiple users 
20 has been described. However^ various embodiments of the invention include modifications 
and optional additions to the system. 
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It is possible for the real-time server 140 to be receiving and transmitting multiple 
different video and audio signals through the web server 131. Additionally, multiple web 
servers could be accessing the information fiom the real-time server 140. Additionally, 
multiple real-time servers 140 could be providing information for the web server 131. 
S In some embodiments of the invention, users can select either the audio stream, the video 

stream, or both the audio and video stream from a server. Similarly, some users can select 
one of these sets of streams while other users select other sets of streams. Additionally, some 
users can select difTerent rates for audio or video infomiation than other users. In such 
systems, the real-time server 140 supplies the data corresponding to the requested rates to the 
10 shared memory 135. For example, if one user is requesting a first audio rate and a second 

user is requesting a second audio rate, the shared memory 135 would store audio data for both 
audio rates of compression. In some embodiments, the web server 131 notifies the real-time 
server 140 when a particular audio rate is not required by any of the processes anymore. 
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